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ABSTRACT 



An apparatus and method for processing a real input 
signal representing frames of video information is dis- 
closed. The apparatus and method are embodied in a 
digital filter comprising means for filtering a real input 
signal to produce therefrom a real output signal having 
desired characteristics, the filtering means selecting and 
acting in accordance with ones of a series of single filter 
operating parameters selected as a function of real input 
signal conditions and means for recalling the selected 
ones of the parameters from a memory, the parameters 
mathematically derived by simulating a plurality of 
virtual input signals and filtering the virtual input sig- 
nals through multiple virtual filters to produce virtual 
desired output signals. 

36 Claims, 6'Drawing Sheets 
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. INTEGRATED VIDEO SCALING AND feature allows a design engineer to change effectively 

SHARPENING FILTER 311(1 the characteristics of the designed filter to 

accommodate changes in application environment 

TECHNICAL FIELD OF THE INVENTION There are two distinct classes of digital filters: infinite 

The present invent ion relates, in general, to digital 5 ^P^f response ("IIR") and finite impulse response 

signal filters and, more particularly, to a polyphase filter ("FIR") filters. 

that can enlarge a video image and sharpen signal transi- ^ IIR ^ ter ^ an infinite-length weighted sum of 

tions to increase image sharpness and fidelity. present and previous inputs to the filter and past outputs 

ta a t~*v /~* o or txtp\ rttr -mu nm/cxmnxi from ^ fflter - A general representation of an IIR filter 

BACKGROUND OF THE INVENTION io fe expressed by the following equation. 

Many fields of science and engineering, such as phys- 
ics, communications, medicine, control systems and # ^ 
radar, are concerned with the detection and manipula- ><") = ffjtK" - k) + 6*x</j - *) 
tion of signals. In these applications and in many others, ~~ 
it is desirable that the frequency spectrum of a signal be 15 ru * r c™ cli - . ' 
modified, reshaped or otherwise m^pulated according ™ e output of an FIR filter is a finite-length weighted 
to a particular deification. For example, the proceJ SUm ° f , P«^» d P revi ^^ uts t0 the fflter ' 
may include ampUfying or attenuating a range of fre- representation of an FIR filter is expressed by 
quency components and rejecting or isolating one spe- ™ foUowm g equation, 
cific frequency component. 20 

Any system or network that exhibits frequency-selec- , . M . _ ^ 

tive characteristics is called a filter. Several types of * = kto^ w ^ 
filters can be identified: lowpass filters ("LPF") that 

pass only the low frequencies, highpass filters ("HPF*) The advantages of an FIR filter are its linear phase 

that pass high frequencies, bandpass filters ("BPF") that 25 response and its high degree of stability (no poles), 

pass a band of frequencies, and band-reject frequencies The above also applies to video signals. Video sig- 

that reject a band of frequencies. Filters are used in a nals, representing visual images, may be encoded in 

variety of applications, such as removing noise from a either analog form or in digital form, wherein the signal 

signal, removing signal distortion caused by a transmis- comprises a plurality of samples representing chromi- 

sion channel, separating two or more distinct signals 30 nance> luminal or qqIot level. Thus encoded, the 

that were mixed to maximize communication channel signal can be processed in any of the above-noted ways, 

utilization, demodulating signals, and converting dis- Scaling an image to reduce its size ("downscaling") 

crete-tone signals into ^contmuous-time signals. requires that a filter must be used to reduce the fre- 

me term digital filter' refers to a computational quen cy bandwidth of the image. If the frequency con- 

process or algorithm by whjch a digrtal agnal or se- 35 ^ of ^ ■ is not reduced> ^ {r ^ nc ^ ^ 

quence of numbers (achng as an mput) is transformed ^ ^ u aliasing will occuTandTmooth edges 

fX* S d ,^T£ 0f aim,be " £ within the image will bfcome jagged. FIR filters are 
digital signal. Digital filters process signals m the digital n a*Lu m- -* a • • V \ 

domain ^retSime signals), wherSs analog filters QOnD f V ^ t0 bandhmit ^ durm * ** 

pr^ess signals in the analog domain (continuous-time 40 °^^ y applicationSj ^ m mters m ^ 

It is a mathematical reality that a digital signal cannot mented *? i very ^ scale mte 8rated circuit. How- 
contain as much information as can an analog signal ev ^ such filters ^ a great deal of silicon area to 
Therefore, to eliminate frequency aliasing, which can m P lem e^ ^ digitally-implemented filters comprise 
occur if a frequency is undersampled, an analog wave- 45 a P lurahtv of fflter sections, or taps. Thus, the physical 
form must initially be stripped of frequencies that Mez a filter o^P 1 ** ureases as the sharpness of its 
would, if sampled, be aliased. These frequencies, which cmoff mcreases - m «*ay designs, filter sections, 
exceed the so-called "Nyquist frequency" must be pro- or m limited , not t0 optimize filter performance, 
cessed by an analog LPF before sampling. The bandli- bm out of 0051 considerations. Thus many such filters 
mited continuous-time signal can then be converted to a 50 do not have vei ? snar P cutoff regions. The lack of a 
discrete-time signal by periodic sampling. After pro- shar P cutoff region means that the highest frequencies 
cessing, the discrete-time signal can be converted back ^ ^ onlv attenuated, not eliminated. Thus, these 
to a continuous-time signal. highest frequencies remain after the filtering operation, 

In many signal processing applications, it is advanta- giving the image a "washed-out" look, especially 

geous to use digital filters instead of analog filters. Some 55 around the edges of objects. This becomes very appar- 

advantages of using digital filters over their analog ent if the downscaled image is then scaled to increase its 

counterparts are: size ("upscaling"). Upscaling also requires a filter to 

high reliability; remove harmonics of the original image, appearing as 

high accuracy; "ghost images." 

no effect of component drift on system performance; 60 The combination of these two operations of down- 
component tolerances are not critical; scaling to reduce the amount of digital data and upscal- 
finite impulse response; and big the data up to, perhaps, its original size is used in 
linear phase. teleconferencing and compact disk applications to 
These advantages apply to any digital process. transmit data. For example, a telecommunications sys- 
Another important advantage of digital filters, when 65 tern can convert standard TV images to a Common 
implemented with a programmable processor, is the Interchange Format (say, CIF 352 by 288 pels), down- 
ease of c h a n g i ng filter parameters electronically and . scale and compress these images to match a telephone 
automatically to modify the filter characteristics. This line transmission rate, and send the images to a receiv- 
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ing station, where the images would be decompressed 
and upscaled to a TV frame size, which could be dis- 
played. Since both the downscaling and compression 
operations attenuate higher frequencies, the displayed 
image, following decompression and upscaling, will 
look washed out If these high frequencies could be 
amplified by adjusting the upscaling Miter, the image 
will become sharper. If the sharpening operation could 
be combined with the upscaling operation (or the down- 
scaling operation), silicon area could be minimized. 

The prior state of the art required two separate and 
distinct operations to accomplish scaling and sharpen- 
ing: a scaling operation done by a scaling filter and a 
sharpening operation wherein the image is separated 
into two intermediate images (normal and LPF filtered 
images). Next, the two intermediate images are aver- 
aged by weighted sum. Finally, frequencies that are 
common to passband regions of the intermediate normal 
and LPF filtered images are attenuated resulting in a 
sharper image. 

If F is the frequency response of the normal image 
and Fl is the response of the LPF filtered image, then 
the overall frequency response G, where c is a constant 
(ranging from 0.6-1,0), is given by the following equa- 
tion: 



c « 



2 X c — l 



xn- 



1 - e 



2 X c- 1 



35 



where G is a single filter overall frequency response, Fl 
is a frequency response of a higher resolution LPF and 
F2 is a frequency response of a lower resolution LPF. 

The prior art is entirely devoid of a method for com- 
bining these operations of scaling and sharpening into a 
single FIR filter, the FIR filter occupying the same 
amount of silicon area as formerly required by the either 
the scaling or the sharpening filters of the prior art 

Therefore, it is a primary object of the present inven- 
tion to provide an integrated scaling and sharpening ^ 
filter, implemented in a very large scale integrated cir- 
cuit, for scaling and sharpening a digital video signal in 
a single step. 

The filter of the present invent ion is designed to scale 
a video image either up or down, in a noninteger fash- 45 
ion, and to allow for separate degrees of scaling in the 
vertical and horizontal directions. 

Finally, the filter of the present invention is designed 
to process video images in real time as they are re- 
ceived. 

These and other objects will become apparent in 
view of the following summary of the invention. 

SUMMARY OF THE INVENTION 

Accordingly, to accomplish the above noted objects 55 
and others, the present invention is the first to provide 
an apparatus for processing a real input signal represent- 
ing frames of video information comprising (1) means 
for filtering a real input signal to produce therefrom a 



Another object of the present invention to provide a 
digital filter wherein the real input signal is a digital 
signal. 

Still another object of the present invention to pro- 
5 vide a digital filter wherein the real output signal is a 
digital signal. 

Yet another object of the present invention to pro- 
vide a digital filter wherein the filtering mrans com- 
prises a digital filter. 
10 Still yet another object of the present invention to 
provide a digital filter wherein the filtering means com- 
prises a finite impulse response filter. 

And another object of the present invention to pro- 
vide a digital filter wherein the plurality of virtual mul* 
15 tiple filters are interpolating filters having different 
numbers of taps. 

Another object of the present invention is to provide 
a digital filter wherein the plurality of virtual multiple 
filters have similar critical frequencies. 

Still another object of the present invention to pro- 
vide a digital filter wherein one of the plurality of vir- 
tual multiple filters has a sharper transition region than 
another of the plurality of virtual multiple filters. 

Yet another object of the present invention to pro- 
vide a digital filter wherein one of the plurality of vir- 
tual multiple filters is interpolated from another of the 
plurality of virtual multiple filters by a fast Fourier 
x Fl . transform algorithm. 

Still yet another object of the present invention to 
provide a digital filter wherein the plurality of virtual 
multiple filters are combined using the equation: 



20 



25 



30 



2XC-1 



X FX - 



1 - e 



2 X c- 1 



X Fl 



where G is a single filter overall frequency response, Fl 
is a frequency response of a higher resolution LPF, F2 
is a frequency response of a lower resolution LPF and c 
is a constant ranging from 6.6 to 1.0. 

In the attainment of the above objects, the preferred 
embodiment of the present invention is a system for 
enlarging and sharpening fields (or frames) of video 
information as represented in a real-time-time input 
signal comprising (1) means for storing a series of single 
filter operating parameters from a memory, the parame- 
ters mathematically derived by simulating a plurality of 
virtual input signals and filtering the virtual input sig- 
nals through discrete, virtual enlarging and sharpening 
filters to produce virtual desired output signals (2) 
means for selecting ones of the series of parameters 
from the memory as a function of real-time input signal 
conditions and (3) means for filtering a real-time input 
signal to produce therefrom a real-time output signal 
having desired characteristics, the filtering means act- 
ing in accordance with selected ones of the series of 
parameters. 

The foregoing has broadly outlined the features and 
technical advantages of the present invention so that the 
detailed description of the invention that follows may 
real output signal having desired characteristics, the 60 be better understood. Additional features and advan- 



50 



filtering means selecting and acting in accordance with 
ones of a series of single filter operating parameters 
selected as a function of real input signal conditions and 
(2) means for recalling the selected ones of the parame- 
ters from a, memory, the parameters mathematically 65 
derived by simulating a plurality of virtual input signals 
and filtering the virtual input signals through multiple 
virtual filters to produce virtual desired output signals. 



tages of the invention will be described hereinafter that 
form the subject of the claims of the invention. It should 
be appreciated by those skilled in the art that the con- 
ception and the specific embodiment disclosed may be 
readily used as a basis for modifying or designing other 
structures for carrying out the same purposes of the 
present invention. It should also be realized by those 
skilled in the art that such equivalent constructions do 
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not depart from the spirit and scope of the invention as digital compression techniques, store the image on a 
set forth in the appended claims. computer, or mix the image with computer graphics. 

BRIEF DESCRIPTION OF THE DRAWINGS F ° r theSe reaSOnS 311(1 m0re > scaUn S methods of 

BRIEF DESCRIPTION Or THE DRAWINGS ^ present mvention involve sca ^ ng xssing prR 

For a more complete understanding of the present 5 filters. (When implementing FIR filters for scaling in 

invention and the advantages thereof, reference is now silicon, care must be taken to produce a quality image in 

made to the following descriptions taken in conjunction a minimum amount of silicon area. For every stage (tap) 

with the accompanying drawings, in which: of an FER filter, a multiplier must be implemented (ei- 

FIG. 1 illustrates a top level block diagram of a cir- ther in silicon area or by running an existing multiplier 

cuit for scaling and sharpening digital signals; 10 at a higher rate). In addition, for every tap used for the 

FIG. 2 illustrates a flow diagram for operation of the vertical direction, a line of memory must be added in 

circuit of FIG. 1; silicon to store lines for the vertical filtering operation. 

FIG. 3A illustrates an impulse response diagram of a ^ image zooming is also required, control must be im- 

first filter, plemented to create an output rate higher than the input 

FIG. 3B illustrates an impulse response diagram of a 15 rate - 

second, more similar filter; The current state of the art involves scaling the image 

FIG. 3C illustrates a frequency response of the filter U P bv tw0 m ea ^ h direction and then scaling down. This 

produced when the waveforms of FIGS. 3 A and 3B are requires two different sets of filters to perform one 

combined according to the invention; operation. The present invention merges these two 

FIG. 3D illustrates an enlarged portion of the wave- 20 °P erations mt0 one mt ™> thus saving silicon area. Other 

form of FIG; 3C* operations such as chrominance resampling may also be 

FIG. 4A illustrates an impulse response diagram of a mer S ed mt0 lhls sin S le SC3hn ^ unit ( e -S- conversion 

first filter between 4:2:2 and 4:2:0 resampling). 

FIG. 4B illustrates an impulse response diagram of a „ ^ e mathematics of scaling are well known and will 

second, less similar filter; 25 * ot ***** ^ Toreduc* the size of an image, 

FIG. 4C illustrates a frequency output of the filter ^er ehmmates high frequency that would cause 

produced when the wavefonns of FIGS 4A and 4B are ^liasmg^When zoonung an image by a factor of n^n 

combined according to the invention; copies O^armomcs) of the images wtil be produced. The 

FIG. 4D illustrates an enlarged portion of the wave- , n ^ ehmmates nunus the baseband image, 

f f FIG 4C & ^ 30 Scaling down an image will wash out an image contain- 

en \ J i v*. * v « « ing high frequencies. If this image is then zoomed up the 

HO. 5 Castrate a plurality of s^gand sharpening i^g/wfli look even more washed out 

curves for use with the circuit of FIG. 1, the curves ^ • „ ^ .«. w n 

r . , . , The present mvention combines zooming with a 

V3 5^ g ^,i a ^ n f° n f d Sf d , A u sharpening operation, resulting in an improvement in 

FIQ. f illustrates a plurality of scaling and sharpening 35 the ^ ^ ^ ^ mventio ^ describes a 

curves for use with the circuit of FIG. 1, the curves metho d for providing zooming, shrinking, sharpening 
varying as a function of desired sharpening; and chrorninance resampling into the same scaling unit 

FIG. 7 illustrates decimation of a stream of mput providmg for ^ efficient silicon implementation. In 
samples and attenuation of high frequencies; addition, the operation b & e horizontal and vertical 

FIG. 8 illustrates interpolation of a stream of sharpen- 40 dimensions are independent allowing for zooming in 
ing of frequency components; and input samples by a one dimension while shrinking in the second and visa 
factor of 133, but with no versa. This implementation involves polyphase filters. 

FIG. 9 illustrates interpolation of a stream of mput The methodology of the present invention involves 
samples by a factor of 1.33 with various sharpenings of the generation of two interpolating filters having differ- 
frequency components. 45 ent numbers of taps, Filter 1 has twice as many taps (an 

DETAILED DESCRIPTION OF THE even number) and twice the frequency resolution as 

INVENTION ^ ter 2 * ^ ^ ter ^ interpolated using a fast Fourier 

transform program, the two filters will have the same 

Reducing an analog signal (e.g. by a factor of two) critical frequencies, but filter 1 will still have a finer 
can be done by passing a signal through a low pass filter 50 frequency resolution and a much sharper transition 
that would eliminate frequencies above the Nyquist region. If the filters are combined as follows: 
frequency, and resampling the filtered signal by per- 
forming a sample and hold operation at the output rate c } _ 
that is half of the input rate. A digital resampler may be G — 2 x c - 1 xfl " 2xc - 1 x ^ 
implemented by converting the analog signal to a digital 55 

level sample at a frequency f(in), passing the digital data where G is a single filter overall frequency response, Fl 
through a digital low pass filter and foDowed by a is a frequency response of a higher resolution LPF, F2 
resampler that retains every other point. is a frequency response of a lower resolution LPF and c 

However, some differences exist between a digital is a constant ranging from 0.6 to 1.0, the frequencies at 
and an analog filter. Analog filters are made of combi- 60 the leading edge of the transition region will be attenu- 
nations of operational amplifiers yielding a filter that ated. 

has both poles and zeros in the transfer function. These An important aspect of the present invention is that 
filters have both an infinite impulse response (Ilk) and Filter 1 have an integer multiple of the number of taps 
usually have a non-linear phase response. Both of these in Filter 2. For example, as described above, Filter 1 has 
characteristics are undesirable in images producing 65 twice as many taps as does Filter 2. Filter 1 could have 
distortions around sharp transitions in the image. To three, four or five times as many taps. However, If 
reduce these effects, FIR filters are used in image seal- Filter 1 were to have a noninteger multiple of taps, say 
ing. Digital image scaling allows the user to perform l.S times as many taps as Filter 1, the resulting sets of 
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frequency component lobes of Filters 1 and 2, as will be ling/sharpness curve" block 202 wherein a particular 
shown later, would be misaligned with respect to one scaling/sharpness curve (the details of which will be 
another, causing beating of frequencies and resulting in explained later) is selected, based upon desired scaling 
poor output image quality. and sharpness variables. This, essentially, is the function 

The present invention for image scaling and sharpen- 5 of controller 106 of FIG. 1. Execution proceeds to 
ing may be viewed as a process that resamples an image deceive new sample" block 203, wherein a new sample 
at a rate different than the input rate. Although images (102 of FIG. 1) is received into the interpolator 101 of 
contain both a horizontal and a vertical dimension, the FIG. 1. Next, execution proceeds to "determine phase 
scaling operations in the horizontal and vertical dimen- on curve" block 204, wherein the controller 106 of 
sions can be performed one after the other. Thus, the 10 FIG. 1 decides, based on desired scaling and sharpness, 
present invention is disclosed with an explanation of the where an output sample is in relation to an input sample, 
scaling techniques with respect to only one dimension This will be explained later. However, at this point, it is 
(the horizontal) with the knowledge that the same tech- sufficient to say that the controller 106 of FIG. 1 pro- 
niques may be used in the other dimension (the vertical, duces phase data that is used to. select where, on the 
provided a memory capable of storing lines of image 15 selected curve, a proper coefficient is to be found, 
data is provided). Execution proceeds to a "retrieve coefficients from 

Turning now to FIG. 1, shown is a top level block curve" block 205, wherein, based upon the selected 
diagram of a circuit for scaling and sharpening digital curve and the selected phase, the controller 106 of FIG. 
signals. The circuit comprises an interpolator 101 that 1 points to a particular location in the coefficient mem- 
receives a plurality of digital samples 102, the samples 20 ory 104 of FIG. 1, that location containing coefficients. 
102 arriving serially at a predetermined rate not under for use with the samples 102 of FIG. 1. 
control of the present invention and, in the preferred At this point, the new sample resides in the multiplier- 
embodiment of the present invention, in real time. The /accumulator 103 of FIG. 1, along with three proximate 
interpolator 101 collects and holds, if necessary, the samples (the new sample's neighbors). These four input 
samples 102. A multiplier/accumulator 103 receives the 25 samples, taken together, will be used to produce a single 
samples 102 from the interpolator 101 and applies, in a output sample. Next, execution proceeds to an "apply 
manner that will be described more fully later, a plural- coefficients to sample and neighbors" block 206, 
ity of coefficients, delivered from a coefficient memory wherein four coefficients retrieved from the coefficient 
104. The coefficient memory 104 stores a plurality of memory 104 FIG. 1 are multiplied by the four respeo 
co efficient curves, each curve relating to particular 30 rive input samples in the multiplier/accumulator 103 of 
ranges of input variables. As will be shown later, these FIG. 1 to produce a single output sample. The output 
curves are symmetrical about a centerline. Therefore, sample is a weighted average of the four input samples, 
the coefficient memory 104 need only store one half of The coefficients are the weights. The output sample is 
each curve. therefore interpolated from the input samples, thereby 

From the multiplier/accumulator 103, the samples 35 allowing resampling of a stream of samples at a variable 
102 travel to a decimator 105, that either accepts or rate. Variable-rate interpolation forms the basis of 
rejects particular samples in a manner that will be de- image upscaling or downscaling. The relative weights 
scribed later. Finally, acceptable samples 102 are deliv- given proximate input samples to produce a particular 
ered to a memory 109 for storage and later use. output sample forms the basis of variable sharpening. 

The coefficient memory 1 04 and decimator 105 are 40 The present invention is the first to recognize these 
under control of a controller 1Q 6 that has, as its inputs , interrelated concepts. 

commands relating t o scaling 10 7 and^sh arpness 108. Next, execution proceeds to a "delete invalid sam- 
Based on the scaling 107 and sharpness 108 inputs, the pies" block 207, wherein output samples are determined 
controller 106 points to particular coefficients stored in to be either valid or invalid in a manner that will be 
the coefficient memory 104. The coefficients are de- 45 described later. Execution next proceeds to a <f store 
rived from weighting curves, some of which are illus- valid samples in memory" block 208, wherein output 
trated in FIGS. 5 and 6. These coefficients are delivered samples that are determined to be valid, are stored in 
to the multiplier/accumulator 103 and are applied to the memory 109 of FIG. 1 for later use. 
samples 102 as they arrive to produce output samples. Finally, execution proceeds to a "need different 
The controller 106 also delivers a signal to the 50 curve? " decisional block 209, wherein the controller 
decimator 105 that directs the decimator to accept or 106 of FIG. 1 either selects or does not select a different 
reject a particular output sample passing through the curve. This is based upon the scaling and sharpness 
decimator. The controller 106 bases its decision to ac- inputs 107, 108 to the controller 106. Each particular 
cept or reject a particular output on whether the output curve is valid for a particular scaling and sharpness 
sample has been validly derived. An output sample is 55 range. If those inputs 107, 108 move out of the scaling 
validly derived when it represents a weighted average and sharpness range for the active curve, the controller 
of the input . samples nearest it. The multiplier/ac- 106 will respond by selecting a different curve based 
cumulator 103 is capable of producing a constant stream upon the values of the inputs 107, 108. Otherwise, the 
of output samples, as it always has access to input sam- curve will remain the same. As can be seen in FIG. 2, 
pies and selected coefficients. However, unless the out- 60 execution continues to either block 202 or block 203, 
put samples thus derived are based on the proper input depending upon whether the answer to decisional block 
samples, they are false, and, if not discarded, would 209 is "yes" or "no." 

serve to distort the output image. Thus, the decimator Turning now FIGS. 3A, 3B, 3C and 3D, taken in 
105 serves the valuable function of retaining only valid conjunction, shown are a plurality of curves represent- 
output samples. 65 ing input and output waveforms in an example wherein 

Turning now to FIG. 2, shown is a flow diagram for the output samples are not sharpened. FIG. 3A illus- 
operation of the circuit of FIG. 1. Execution begins in a trates an impulse response diagram of a first filter, FIG. 
"start" block 201. Execution proceeds to a "select sea- 3B illustrates an impulse response diagram of a second, 
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more similar filter, FIG. 3C illustrates a frequency re- are shown two curves, jointly designated 501. One 

sponse of the filter produced when the waveforms of curve 505 is used when the output image is desired to be 

FIGS. 3 A and 3B are combined according to the inven- scaled up by, at most, a factor of 2.0. Curve 506 is used 

tion and FIG. 3D illustrates an enlarged portion of the to scale an image up by, at most, a factor of 2.5. For 

waveform of FIG. 3C 5 purp oses of FIG. 5, the curves 501 each sharpen the 

As stated before, an input waveform, represented as a mput image to ^ ^ extent Therefore, the differ- 

plurahty of samplesrecerved in real time, ■filtered by ence in the curves is attributable entirely to the scaling 

*vo filters having d^erent lengths but similar critical function . 7^ ordinate of the graph shown in FIG. 5 is 

frequencies. In FIGS. 3A and 3IMhese filters are very ^ k numbe ^ ^ ^ u 

smular and can bel fought of asbemg exactly the same. , 0 ^ 103j whfle ^ abscissa * ^ of 

This is shown in FIGS. 3A and 3B as two filtered input , . , . ' ^ 

waveforms having similar geometries 301, 302. The two g r , _ . J . ^ 

waveforms shown in FIGS. 3A and 3B are combined . By ™ y of example, assume it is d^red to scale an 

according to the following equation: m ^ U P bv a factor of L5 - Therefore, in the 

output image, there will be 1.5 samples for each single 

15 sample in the input image. Thus, three output samples 

G ~ 2xc-i x n ~ 2x7-1 x w must be generated from every two input samples. The 

weighting that gives rise to interpolation and generation 

where G is a single filter overall frequency response, Fl °f ^ c output samples is derived from the curves S01 of 

is a frequency response of a higher resolution LPF, F2 ^ FIG. 5. Specifically, if it is determined that an output 

is a frequency response of a lower resolution LPF- and c sample should be generated at precisely the same point 

is a constant ranging. from 0.6 to 1.0. in an image where an input pixel presently exists, the 

The resulting waveform is shown FIG. 3C and com- , input pixel at that location 0.00, according to curve 505,, 

prises a plurality of lobes 303. These lobes 303 indicate is weighted at 1.00. Samples on either side of the sample 

frequency components in an image. These components - at 0.00 (namely, — 1.00 and 1.00 are weighted at 0.00 

define the visual content in a field or frame of video shown by zero cross-over points 503, 504, respectively, 

data. These components can be made sharper and unde- This represents a trivial case and intuitively apparent, 

sirable high frequencies proximate the components can since, when one desires to interpolate an output sample 

be attenuated through use of the present invention. A at a location that is identical to an input sample, the 

particular lobe 304 is shown in FIG. 3D in an enlarged weighting of the input sample should be total (unitary), 

fashion. The lobe 304, as is shown in FIG. 3D, does not * md no weight should ^ g ven to a^ent samples, 

contain a sharp transition region. Neither does lobe 304 A less trivial ^ however, arises with respect to the 

show attenuation of high frequencies around the transi- next output m le to be derived> ^ out £ t le 

don region. Therefore, the output waveform produced must « reside „ of ^ way bct ^ ai a ^ 

by ffltersrttvm^ mput sample and a second input sample. Therefore, the 

^ no , mC I e T l S ^2? S * 1 3 L ak0 controller 106 of FIG. 1 must provide an offset to the 

coefficient memory 104 to thereby access a different 

difficult to attenuate and do not serve to significantly „„ w ^ + , J cnc , a ^ / , . . , 

. c , r . f ,, . — . f * part of the curve 505 (effectively bringing about a 

harm the fidelity of the image. Therefore, the present !\ , . i . J rjk , * 

invention operaL on the lob! 304; any change brought I^aT" P \ t ^ IT! ' 

aboutto the other lobesis merely aby-produrtof opJra- <° P"^of that curve niust be shifted to theleft toapomt 

»- t , , . . 1 v ^ two-thirds of the distance between — 1.00 and 0.00. As 

Don on tne lobe 30*. . . . , , ,. 

On the other hand, turning now to FIGS. 4A, 4B, 4C s * 0Wn ' ^ w <f<*'f*V* aw «^t for the first sample 

and 4D, shown are four figures corresponding to FIGS. °f approximately 0.3 and weights for the adjacent sam- 

3A, 3B, 3C and 3D. FIG. 4A mustateTan impulse ples of a PP roxmatel y -M and 0.8, respectively. The 

response diagram of a first filter, FIG. 4B illustrates an 45 sum , of the weights remams 1.00, that is properly nor- 

impulse response diagram of a second, less similar filter, ™teed. ™«\ cu ™ 505 is selectively sampled 
FIG. 4C illustrates a frequency output of the filter pro- the length thereof to denve coefficients that vary 

duced when the waveforms of FIGS. 4A and 4B are 88 a ^^on of the relationship of output samples to 

combined according to the invention and FIG. 4D illus- m P ut s™Pl«- It is readily apparent that if .the output 

trates an enlarged portion of the waveform of FIG. 4C. 50 samples are to be greater in number than the input sam- 

As shown in FIGS. 4A and 4B, the amplitudes of the P les (indicating an upscaling of the input image), then 

impulse responses 401, 402 are different This difference ^ e P 1 * 3 ^ of the curve 505 will retard, or move to the 

is due to differences in filter characteristics. The cone- right, as previously shown. On the other hand, if the 

spending output waveform shown in FIG. 4C again has m P ut image is to be downscaled, the phase will ad- 

a plurality of lobes 403, but the lobes 403 have been 55 vance, or move to the left. The factor by which the 

accentuated. One lobe 404 is shown in enlarged form in input image is upscaled or downscaled determines the 

FIG. 4D. Shown are two lobes 404, 405 that have a rate of phase change in the curve 505, in other words, 

sharper transition therebetween and high frequencies, toe "Velocity" of the phase retard or advance, 
that were proximate the lobe 304 of FIG. 3D, are atten- Of course, it should be recognized that the curve 505 

uated. This sharpens the resulting image. 60 only applies for upscaling to a factor of, at most, 2.0 

Turning now to FIG. 5, shown is a plurality of seal-. times the input image size. Therefore, when downscal- 

ing and sharpening curves for use with the circuit of ing or upscaling beyond that factor is required, a differ- 

FIG. 1, the curves varying as a function of desired ent curve will be selected, even though the phase 

scaling. The curves, generally designated 501, are actu- change along that curve will remain the same, 
ally a set of coefficients or weights that, when applied to 65 It is important to note that the curves 505, 506 differ 

input samples, produce output samples having desired with respect to amplitude at their low points. This is so 

characteristics. The most effective way to understand because each curve 505, 506 is selected to best operate 

the curves 501 is by way of example. In FIG. 5, there with respect to a different range of scaling factor. Curve 
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selection is based on subjective, iterative analysis with a 
view toward image quality maximization. The differ-, 
ence in these curves 505, 506 is attributable to this analy- 
sis. 

Turning now to FIG. 6, shown as a plurality of 5 
curves, generally designated 601 and comprising curves 
605, 606, 607, having maximum 602 and zero cross-over 
points 603, 604. The curves as shown in FIG. 6 each 
provide scaling of up to 1.5 times the input image size. 
However, each of the curves has a different sharpness 10 
factor applied. Curve 505 has a sharpness factor of &68, 
that is considered to be a substantial sharpening. Curve 

606 has a sharpening factor of 0.80, that produces an 
output image of somewhat less sharpness, while curve 

607 has a sharpness factor of 1.00, indicating no increase 15 
in sharpness in the output image over the input image. 
The explanation given above with respect to scaling in 
the curves 501 in FIG. 5 applies to the curves in FIG. 6. 
That is, phase and phase change along the curves are a 
function of the relationship of the location of output 20 
samples with respect to the location of input samples (a 
function of interpolation of samples). 

FIG. 6, however, is shown for the purpose of illus- 
trating the difference in curves brought about by a 
difference in sharpening factors. It is intuitively appar- 25 
ent in FIG. 6 that the greater the sharpening of the 
output image, the greater the difference in weighting 
factors applied to adjacent input samples. This is evi- 
denced by the higher peak-to-peak amplitude character- 
istic of the curve 605, in comparison with curves 606, 30 
607, each having lower peak-to-peak amplitudes. An 
increased peak-to-peak amplitude indicates a greater 
varying in weighting between adjacent samples and, 
therefore, a greater contrast or change between output 
samples and attenuation of higher frequencies in transi- 35 
tion regions, giving rise to greater image sharpness. The 
extent to which the output image is sharpened is select- 
able in the preferred embodiment of the present inven- 
tion. 

Turning now to FIG. 7, illustrated is decimation of a 40 
stream of input samples and attenuation of high frequen- 
cies. The input samples consist of low frequencies 701 
and high frequencies 702. These low and high frequen- 
cies 701 and 702 are decimated and sharpened by the 
filter of the present invention to produce a stream of 45 
output samples consisting of low frequencies 703 and 
high frequencies 704. In FIG. 7, it is important to note 
that the high frequencies 702 have been substantially 
attenuated following application of the filter. Thus high 
frequencies 704 are significantly diminished, particu- 50 
larly within a cutoff region 705. 

Turning now to FIG. 8, illustrated is interpolation of 
a stream of input samples by a factor of 1.33, but with no 
sharpening of components. Again, as in FIG. 7, low and 
high input and output frequencies 801, 802, 803, 804 are 55 
shown, but it is apparent that the output frequencies 
803, 804 have a period that is four-thirds of the period of 
the input frequencies 801, 802. This is interpolation. 

Turning now to FIG. 9 illustrated is interpolation of 
a stream of input samples by a factor of 1.00 with van- 60 
ous sharpenings of frequency components therein. Un- 
like FIGS. 7 and 8, that show input and output sample 
streams, FIG. 9 shows two output sample streams, each 
sharpened by a different sharpening factor. Low and 
high frequencies 901, 902 are sharpened by a factor of 65 
0.68, that results in significant sharpening, while low 
and high frequences 901, 902 are sharpened by a factor 
of 1.00, that corresponds to no sharpening whatsoever. 



Since both sample streams 901, 902, 903, 904 have been 
scaled by the same scaling factor, they appear to have 
the same relative periods. 

In FIG. 9 it is important to note that high frequencies, 
that are present in a region 905, are not present in a 
corresponding region 906. This increase in amplitude of 
high frequencies in the region 905 gives rise to greater 
sharpness of the image, as has been described. 

Although the present invention and its advantages 
have been described in detail, it should be understood 
that various changes, substitutions and alterations can 
be made herein without departing from the spirit and 
scope of the invention as defined by the appended 
claims. 

What is claimed is: 

1. An apparatus for processing a real input signal 
representing frames of video information, comprising: 

means for filtering a real input signal to produce 
therefrom a real output signal having desired char- 
acteristics, said filtering means selecting and acting 
in accordance with ones of a series of single filter 
operating parameters selected as a function of real 
input signal conditions; and 

means for recalling said selected ones of said parame- 
ters from a memory, said parameters mathemati- 
cally derived by simulating a plurality of virtual 
input signals and filtering said virtual input signals 
through multiple virtual filters to produce virtual 
desired output signals. 

Z The apparatus as recited in claim 1 wherein said 
real input signal is a digital signal. 

3. Trie apparatus as recited in claim 1 wherein said 
real output signal is a digital signal. 

4. The apparatus as recited in claim 1 wherein said 
filtering means comprises a digital filter. 

5. The apparatus as recited in claim 1 wherein said 
filtering means comprises a finite impulse response fil- 
ter. 

6. The apparatus as recited in claim 1 wherein said 
plurality of virtual multiple filters are interpolating 
filters having different frequency , resolution. 

7. The apparatus as recited in claim 1 wherein said 
plurality of virtual multiple filters have similar critical 
frequencies. 

8. The apparatus as recited in claim 1 wherein one of 
said plurality of virtual multiple filters has a sharper 
transition region than another of said plurality of virtual 
multiple filters. 

9. The apparatus as recited in claim 1 wherein one of 
said plurality of virtual multiple filters is interpolated 
from another of said plurality of virtual multiple filters 
by a fast Fourier transform algorithm. 

10. The apparatus as recited in claim 1 wherein said 
plurality of virtual multiple filters are combined using 
the equation: 



G — 



2XC-1 



X F\ - 



1 -c 



2Xe-l 



X Fl 



where G is a single filter overall frequency response, Fl 
is a frequency response of a higher resolution LPF, F2 
is a frequency response of a lower resolution LPF and c 
is a constant ranging from 0.6 to 1.0. 

11. A method of processing a real input signal repre- 
senting frames of video information, comprising the 
steps of: 

. storing a series of single filter operating parameters in 
a memory, said parameters mathematically derived 
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by simulating a plurality of virtual input signals and dance with selected ones of said series of parame- 

filtering said virtual input signals through virtual ters. 

multiple filters to produce virtual desired output 22. The system as recited in claim 21 wherein said 

signals; and real-time input signal is a digital signal, 

filtering said real input signal with a real single filter 5 23. The system as recited in claim 21 wherein said 

to produce therefrom a real output signal having real-time output signal is a digital signal 

desired characteristics, said real single filter select- 24. The system as recited in claim 21 wherein said 

ing and acting in accordance with selected ones of filtering me a n s comprises a digital filter, 

said single filter operating parameters as a function 25. The system as recited in claim 21 wherein said 

of real input signal conditions. 10 filtering means comprises a finite impulse response fil- 

12. The method as recited in claim 11 wherein said ter * 

real input signal is a digital signal 26. The system as recited in claim 21 wherein said 

13. The method as recited in claim 11 wherein said virtual enlarging and sharpening filters are interpolating 
real output signal is a digital signal. fllters having different frequency resolution. 

14. The method as recited in claim 11 wherein said 15 21 ' The system as recited in claim 21 wherein said 
real single filter comprises a digital filter. virtual enlarging and sharpening filters have similar 

15. The method as recited in claim 11 wherein said critical frequencies. 

real single filter comprises a finite impulse response M * ^ system as recited in claim 21 wherein one of 

fil ter said virtual enlarging and sharpening filters has a 

16. The method as recited in claim 11 wherein said 20 shar P er transition region than another of said virtual 
plurality of virtual multiple filters are interpolating and sharpeninfi fllters ; . 

filters having different frequency resolution. 7 1 * f^ st f m ^ recited m claim 21 wherein one of 

17. The method as recited in claim 11 wherein said enlarging and sharpening filters is interpo- 
plurality of virtual multiple filters have similar critical „ Iated f !l om T J ^ VUtUal sharp- 
frequencies 6111118 ers y a fast Founer transform algorithm. 

18. The method as recited in claim 11 wherein one of J 1 *, * y ** m " "f"* » c1 *™ 21 wherein said 
said plurality of virtual multiple filters has a sharper ^ [ J B * U #** md sharpemng fflters *** combmed 
transition region than another of said plurality of virtual usm 8 e ^V 1 * on - 

multiple filters. ^ 

19. The method as recited in claim 11 wherein one of G = % * _ x x f\ - 2 l \ x F2 
said plurality of virtual multiple filters is interpolated C Xe 

from another of said plurality of virtual multiple filters where G is a single filteroverall frequency response, Fl 

y ,n £ ^ZJ Worm^gorrthm b a f ^ of a ^ H TCSol ^ OTi P LPFj F2 

20 The method as recited in claim 11 wherein said 35 * a frequency resp onse of a lower resolution LPF and c 

plurality of virtual multiple filters are combmed using k a constant ^ from 0 6 to l 0 

the equation: 3L ^ apparatus f or processing a real input signal 

representing frames of video information, comprising: 

x & _ 1 - c x n means for storing a plurality of coefficients in a mem- 

40 ory, the coefficients representing weighting fac- 
tors; and 

where G is a single filter overall frequency response, Fl means for applying selected ones of said coefficients 

is a frequency response of a higher resolution LPF, F2 to a plurality of received input samples, said coeffi- 

is a frequency response of a lower resolution LPF and c cients selectably sharpening and providing a basis 

is a constant ranging from 0.6 to 1.0. 45 f or selectable interpolation of said input samples to 

21. A system for enlarging and sharpening frames of thereby produce a plurality of output samples, 

video information as represented in a real-time-time 32. The apparatus as recited in claim 31 wherein said 

input signal, comprising: input samples represent a portion of a digitized input 

means for storing a series of single filter operating visual image, 

parameters from a memory, said parameters mathe- 50 33. The apparatus as recited in claim 32 wherein said 

matically derived by simulating a plurality of vir- output samples represent a portion of a digitized output 

tual input signals and filtering said virtual input visual image. 

signals through discrete, virtual enlarging and 34. The apparatus as recited in claim 33 wherein said 

sharpening filters to produce virtual desired output output visual image is a scaled representation of said 

signals; 55 input visual image, 

means for selecting ones of said series of parameters . 35. The apparatus as recited in claim 34 wherein said 

from said memory as a function of real-time input output visual image comprises a plurality of visual fea- 

signal conditions; and tures having components between said visual features, 

means for filtering a real-time input signal to produce 36. The apparatus as recited in claim 35 wherein said 

therefrom a real-time output signal having desired 60 apparatus sharpens said components. 

characteristics, said filtering means acting in accor- ***** 
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